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Abstract 

In this paper, we propose a general approach for improving the efficiency of computing 
distribution functions. The idea is to truncate the domain of summation or integration. 

1 General Theory 

In various fields of sciences and engineering, it is a frequent problem to compute distribution 
functions. Specifically, it is desirable to compute efficiently and precisely the probability 

P = Pr{aj < Xi < bi, i = 1, ■ ■ ■ , m} 

where Xi,-- - ,X m are random variables defined in probability space Pr) and etj, bi, i = 

1, • • • , m are real numbers. Since the probability can be expressed as an m-dimensional summation 
or integration over domain 

D = {{xi, ■ ■ ■ ,x m ) : di < Xi < bi, i =!,■■■ ,m}, 

the computational complexity may depend on the size of D. In many situations, the larger the size 
of domain D is, the more computation is required. Hence, it will be of computational advantage 
to reduce the domain D as its subset 

D' = {(xi, • • • , x m ) : a' { < Xi < b'i, i = !,-■■ ,m} 

such that 

P' = Pr{a- <Xi<b'i, i = !,-■■ ,m} 
is close to P within a controllable difference. For this purpose, we have 
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Theorem 1 Let Ui, Vi, oti, Pi be real numbers such that 

Pr{Xi <Ui}<ai, Pr{Xi 

for i = 1, ■ ■ ■ ,m. Let 

a\ = max(aj, Mj), 6^ = mm(6j, Uj), i = 1, • • ■ , m. 

T/ien, 

m 

P' <P<P' + J2{ai + Pi). 
i=l 

Proof. Obviously, P' < P is true since D' is a subset of D. Thus, it suffices to show P < 

P' + YZM + fr). 

Note that 

P' = PrK < Xi < b' u i = 1, ■ ■ ■ ,m} = Pv{r\Zi(Ai n PI C} 

where 

A; = {Xi > u^, Bi = {Xi < Vi}, i = !,-■■ , m 

and C = {a-i < Xi < b. L , i = 1, ■ ■ ■ , m}. By Bonferroni's inequality, 

m 

Pr{n£ti(A n Bi) HC}> Pr{C} - 2m + ^(Pr{^,} + Pr{5;}). 

i=l 

By the definitions of P and P' , 

in 

P' > P - 2m + ^(Pr{AJ + Pr{B;})- 

i=i 

Hence, 

m 

P < P , + 2?n-^(Pr{A i } + Pr{ J B, t }) 

m 

= P' + J^K 1 - Pr {^» + (1 " Pl '{^})] 

m 

= p' + Y, I Pr {^ < «*} + MX > 

i=l 
m 

< p' + J2( ai +Pi). 

i=l 

This completes the proof of the theorem. 

□ 
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To ensure that P' < P < P' + 77 for a prescribed r\ > 0, it suffices to choose 

a i = A = 7T-- 

As can be seen from Theorem 1, a critical step is to determine u and v for a random variable 
X such that 

Pr{X < u} < a, Pv{X > v} < (3 
for prescribed a, (3 G (0, 1). For this purpose, we have the following theorem. 

Theorem 2 Let X be a random variable with mean [i = E[X]. Let 

tf(z) = infE[e t(x - 2) l. 

Then the following statements hold true: 

(I) For any z > fj,, 

Pv{X >z}< tf(z). 

(II) For any z < fi, 

Pr{X <z}< V(z). 

(III) Both ^(/J + A) and ^(fi — A) are monotonically decreasing with respect to A > 0. 

(IV) For any a € (0, 1), there exists a unique A > such that ^(/i — A) = a. 

(V) For any [5 G (0, 1), there exists a unique A > such that ^(/x + A) = [3. 

Proof. By Jensen's inequality 

E[e< x ^]>e^ x ~ z l 

Hence, if z < fj,, we have E[e* (x ~ z) ] > e * E [ x ~ z l > 1 for t > 0. Similarly, if z > fi, we have 
gj e *(x-z)j > g tE[x-z] > 1 for t < 0. Combing these observations and the fact that 

0<^(z) <E[e 0x ( x -^] = 1, 

we have 

V{z) = { 



inf t<0 E[e*( x " z )] for z < fi, 
inf t>0 E[e i ( x - 2 )] for z > fj,. 



By the Chernoff bounds [T] , 



PrjX > z} < inf Efe t(x -^1 = V(i 



for z < n; and 

for z > fj,. This completes the proof of statements (I) and (II) 



Pi{X < z] < mfE\e t{x - z) ] = «Y; 
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To show that ^(/x + A) is monotonically decreasing with respect to A > 0, let t& be the 
number such that 

inf Ele^x-v-^} = E\e tA< - x -^- A) }. 

Then, is positive and 

Q E l e t A (X-v+Ah 

3U -°- 

It follows that 

dif (// + Z\) dinf 4eR E[e*( x -^)] 



d-d 




















<9E[e*^ x ~^ 





+ 



di 4 3Z\ 

^,1 



+ x 



OA 

8A <0 ' 

Similarly, to show that ^(/x — d) is monotonically decreasing with respect to A > 0, let 
be the number such that 

inf Efe'^+^l = E\e*^ x -^]. 

Then, t& is negative and 

dE[e l ^ x -^ A \ _ 
dt~A ~ 

Consequently, 

<fif (/x - A) dinf tgR E[e f ( x -^ + ^] 
dA ~ dA 



+ 





dA 




dE\ 


e tA(X- 






dA 






e tA(X- 






dA 






e tA (X- 




dA 



dt 4 dA 
dt A 



+ x 



< 0. 



This concludes the proof of statements (III). 
To show statement (IV), note that 



liminf <?f(u -A) = liminf inf E[e* (x ^ +Zl) l > liminf inf e nKX-^+A)] = Hm inf & At = 1 

A^O A^O t<0 A^O t<0 A^O t<0 



and that 



lim <jf (/x - Z\) = (2) 

<4— >oo 
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result of 



and 



liminf<«f(/x- A) > 

zA^oo 



limsup^(/i -A) = limsupinf E[e*( x ^+^] < limsupE[ e - (x -^ +zi) ] = E[ e - (x -^] lim e"" 1 = 0. 

Zi^oo Z\^oo i<0 Zi^oo A^oo 

Hence, (IV) follows from ([I]), (|2|) and the fact that ^(fJ. — A) is monotonically decreasing with 
respect to A > 0. 

To show statement (V), note that 



liminf tf(u, + A) = liminf inf Efe* (Jf 1 > liminf inf e E[«(^-M-^)l = lim inf e -At = x ,3) 

ZWO ZWO t>0 zl^O t>0 z\->0 t>0 



and that 



as a result of 



lim + A) = (4) 

Zl— >oo 



liminf^(/i + Z\) > 

zA-^oo 



and 



lim sup + A) = lim sup inf E[e t{x ~^ A) ] < limsupE[e (x - /1 " zi) ] = E[e (x ^ } ] lim e~ A = 0. 

Zi^oo zl->oo * >0 A^oo A->oo 

Hence, (V) follows from ([3]), (jlj) and the fact that ^{p, + A) is monotonically decreasing with 
respect to A > 0. 

□ 



As can be seen from Theorem 2, since ^(/x — zl\) is monotonically decreasing with respect to 
A > 0, we can determine z_\ > such that "^(/i — A) = a by a bisection search. Then, setting 
u = n — A yields Pr{X < u} < a as desired. Similarly, we can determine A > such that 
^{fJL + A) = (3 by a bisection search and set u = + A to ensure Pr{X > v} < (3. 

2 Applications 

The approach of reducing the domain D to its subset D' is referred to as truncation technique 
in this paper. By the Chebyshev's inequality, it can be visualized that if the variances of Xi are 
small, then the size of the truncated domain D' can be much smaller than that of domain D, even 
though rj is extremely small. 

For the truncation technique to be of practical use, it is desirable that functions ^(z) associated 
Xi have closed form. This is indeed the case for many important distributions. For example, 
when X is the average of i.i.d Bernoulli random variables Y\, ■ ■ ■ ,Y n such that Pr{Y; = 1} = p 
for 1 < i < n, the Hoeffding's inequality [2] asserts that 

Pr{X >z}< <af(V), Vz>p 
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Pt{X <z}< W(z), Vz<p 



where 



py ( i -p 

z) \1- z 



1-2 



For another example, when X is the average of i.i.d Poisson random variables Y\, ■ ■ ■ ,Y n such 
that E{1^ = 1} = A for 1 < i < n, it can be shown by the Chernoff bounds [T] that 

Pi{X >z}< tf(z), Vz > A 

Pr{X <z}< V(z), Vz < A 



where 



Xe 



Similar truncation techniques can be developed for hypergeometric distribution, negative binomial 
distribution, hypergeometric waiting-time distribution, etc. 

In the case that simple and tight bounds of 'rf(z) are available, it is convenient to use the 
bounds in the truncation of D. In this regard, we have established the following result. 

Theorem 3 Let K be a binomial random variable such that Pr{K = i} = (™W(1 — p) n ~'\ i = 
0, 1, ■ ■ • ,n where p £ (0, 1) and n is a positive integer. Then, for arbitrary real numbers a, b and 
any rj G (0,1), 

Pr{T~ < K < T+} < Pr{a < K < b} < Pr{T~ < K < T+} + n 

where 



T = max < 



a, 



l-2p-,/l 



np - 



lSnp(l-p) 

— hT* — 



_2_ , 3 

3r» ' h7^ 



T = min < b, 



l-2p+. 1 



np 



18np(l-p) 

— kT^ — 



_2_ , 3 

3n ' hT? 



with [.J and \.~\ denoting the floor and ceiling functions respectively. 



We would like to remark that T + — T can be much smaller than b — a even though n is chosen 
as an extremely small positive number. 

To prove Theorem 3, we need some preliminary results. 

Lemma 1 Define ^£{z,u) = —pjj: — 1^7 % — ; — r f or < fi < 1 and — 2/i < z < 3 — 2/i. Then, for 

2 (— + S )\3+3 ~ 1 ) 

any fixed [i E (0, 1), ^(z,fi) is monotonically increasing from — oo to as z increases from —2/i 
to fi, and is monotonically decreasing from to — oo as z increases from [i to 3 — 2/i. 



Proof. After a lengthy calculation, we obtained 

cL#(z, /i) (fj, — z) w(z, fi) 



dz 



MxiHl - it — £ 
3 T 3 1 3 3 



where w(z,li) = /i(l - ^ - |) + £ g £ . Noting that w(-2(j,,li) = % > 0, w(fi,n) = fi(l - /i) > 
and that w(z, fj,) is linear with respect to z, we have that w(z,/jl) > for any |U G (0,1) and 
z € (— 2fi,fi). It follows that dJ ^^^ > o for any /i £ (0,1) and z G (— 2fj,,Li). In view of the 
positive sign of the partial derivative and the fact that lim z _ > _2^ -#(z, /i) = — oo, ^#(/x,//) = 0, 
we have that, for any fixed /i € (0, 1), ^(z,li) is monotonically increasing from — oo to as z 
increases from —2// to ll. 

Similarly, observing that w(3 — 2ll,li) = > 0, w(fi,fM) = /x(l — y) > and that w{z,ji) 
is linear with respect to z, we have that w(z,fx) > for any fx G (0,1) and z G (/i,3 — 2/x). 
Consequently, d-^C^) ^ q f or an y ^ g ^ i ^ an( j ^ G (//, 3 — 2/x). In view of the negative sign of 
the partial derivative and the fact that lim z ^3„2^ *#(z, fJ.) = — oo, ^#(//, y) = 0, we have that, 
for any fixed \i G (0, 1), ^(z,fi) is monotonically decreasing from to — oo as z increases from /i 
to 3 — 2/i. This completes the proof of the lemma. 

□ 

The following lemma is a slight variation of Theorem 2 at page 1271 of [3], which was obtained 
by Massart as a byproduct in determining the tight constant in the Dvoretzky-Kiefer-Wolfowitz 
inequality. 

Lemma 2 Let X n = *= ] — - where X\, • • • , X n are i.i.d. random variables such that < X{ < 1 
and EpQ] = fi G (0, 1) /or i = 1, ■ • ■ , n. Then, Pr {l n > z} < cxp (nJt{z, fj,)) for any z G (fj,, 1). 

We can extend Lemma [2] as follows. 

Lemma 3 Let X n = — - where X±, • • • , X n are i.i.d. random variables such that < X{ < 1 
and E[Xj] = [i G (0,1) for i = 1, • • • ,n. Then, Pi{X n >z] < exp(n-#(z, /x)) /or am/ z G 
(/x, 3 — 2/x). Similarly, Pi{X n < z} < exp (n^(z, u)) for any z G (— 2/x,/i). 

Proof. To show Pr{X n > z} < exp (n^(z, u)) for any z G (/i, 3 — 2/x), we shall consider three 
cases: (i) z G (//, 1); (ii) z = 1; (iii) z G (1,3 — 2/x). 

In Case (i), the statement has been established as Lemma [2J 

In Case (ii), we have Pr { X n > z) = Pr{X n = l} = n?=i Pr{*i = 1} < n™=i E [^] = I** '■ 
We claim that ln(/i) < ^#(l,/z). To prove this claim, it suffices to show ln(/x) < g7^ipjn for any 
fj, G (0, 1), since ^#(1, //) = . For simplicity of notation, define g{u) = ln(/i) - 4^+1) • Then, 

the first derivative of g(fi) with respect to fi is g'{y) = 5fl tt^tt^ ~ — ~^ To W* 1 > for any 
H G (0, 1). This implies that g(y) is monotonically increasing with respect to /x G (0, 1). By virtue 
of such monotonicity and the fact that g(l) = 0, we can conclude that g(fi) < for any y G (0, 1). 
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This establishes our claim that ln(/i) < It follows that Pr{X n > z] < exp (n^#(z, /j,)) 

holds for z = 1. 

In Case (iii), since < X n < 1, we have Pr {X n > z} = < exp //)) for z £ (1, 3 — 2//). 

To show Pr{X n < z} < exp (n-#(z, /i)) for any z € (— 2/j, /j), we shall consider three cases as 
follows. 

In the case of z 6 (0, //), we define y = 1 — z and F n = 1 with 1$ = 1— X% for i = 1, • • • , n. 

Then, Pr{X n < = Pr |Y„ > y}. Applying Lemma [2] to i.i.d. random variables Y±,--- ,Y n , 
we have Pr {Y n > y} < exp (y, 1 — //)) = exp (n^#(z, //)) for 1 — // < y < 1, i.e., < z < \i. 
This shows that Pr{X„ < z} < exp (n^(z, fj,)) holds for z £ (0,//). 

In the case of z = 0, we have Pr{X n < z] = Pr{X n = 0} = fCLiC 1 ~ Fr { x i + °» < 
nr=i( 1 - E M) = (! - vY- We claim that fn(l - n) < J?(0,fi). To prove this claim, it 
suffices to show ln(l — fj,) < ^^-z) ^ or air ^ G smce -^(0, //) = 4(2^3) ■ F° r simplicity 

of notation, define = ln(l — fj,) — 4 ^-3) • Then, the first derivative of with respect to 

/* is w = ^i^-g ^ iBM^k < for any " G (0 ' 1} - This implies that ^ is 

monotonically decreasing with respect to fi £ (0, 1). By virtue of such monotonicity and the fact 
that h(0) = 0, we can conclude that h(fi) < for any /j £ (0, 1). This establishes our claim that 
ln(l — /i) < ^#(0, /j). It follows that Pv{X n < z) < exp(n^(z,fj,)) holds for z = 0. 

In the case of z £ (— 2/i,0), since < X n < 1, we have Px{X n < z} = < exp (n^f(z, fi)) 
for z £ (-2/i,0). 

This completes the proof of the lemma. 

□ 

Now we are in a position to prove Theorem 3. By Lemma [H we have that, for any 77 £ (0, 1), 
there exist two real numbers Z\ £ (—2p,p) and Z2 £ (p, 3 — 2p) such that exp [n^(z\,p)) = 
exp (n^(z 2 ,p)) = o- Observing that exp = ? can be transformed into a quadratic 

equation with respect to 2, we can obtain explicit expressions for z\ and Z2 as 



l-2p- Jl + 18 "^" p) 1 - 2p + W 1 + 18 "p^-p) 



z l = P + 2—37^ . Z 2 = P + 2 , 8n 

3 ~r kT^T 3 + kTX 



Hence, by Lemma O we have 



7? 77 

Prji'T < w^i} < exp (n^#(zi,p)) = — , Pt{K > 7722} < exp (n^{z2,p)) ~ 



and 

T~ = max{a, [n^i]}, T + = min{6, [ri^J } - 

It follows that 

Pi{K > [nz 2 \} = Pr{K > [nz 2 j + 1} < Pr{K > nz 2 } < Pr{K > nz 2 } < ~, 
Pr{K < \nzi\] = Pt{K < \nz{\ - 1} < Pr{K < nzi} < Pt{K < nz{\ < |. 
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Since 



Pr{a < K < b] < Pr{T~ <K < T+} + Pr{T + < K < b} + Pr{a < K < T - } 

and 

Pr{T+ < K < b] < Vx{K > [nz 2 ]}, Pr{a < If < T"} < Pr{K < \nz{\), 

we have 

Pr{a < If < 6} < Pr{T~ < if < T+} + ? + ? = Pr{T" < if < T + } + r?. 

On the other hand, Pr{T~ < K < T + } < Pr{a < K < b} is trivially true. This completes the 
proof of Theorem 3. 
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